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ABSTRACT 

Introduction: Tobacco, alcohol and illicit drug use 
contribute significantly to global rates of morbidity and 
mortality. Despite evidence suggesting interventions 
designed to increase adolescent resilience may 
represent a means of reducing adolescent substance 
use, and schools providing a key opportunity to 
implement such interventions, existing systematic 
reviews assessing the effectiveness of school-based 
interventions targeting adolescent substance use have 
not examined this potential. 
Methods and analysis: The aim of the systematic 
review is to determine whether universal interventions 
focused on enhancing the resilience of adolescents are 
effective in reducing adolescent substance use. Eligible 
studies will: include participants 5-18 years of age; 
report tobacco use, alcohol consumption or illicit drug 
use as outcomes; and implement a school-based 
intervention designed to promote internal (eg, self- 
esteem) and external (eg, school connectedness) 
resilience factors. Eligible study designs include 
randomised controlled trials, cluster randomised 
controlled trials, staggered enrolment trials, stepped 
wedged trials, quasi-randomised trials, quasi- 
experimental trials, time series/interrupted time-series 
trials, preference trials, regression discontinuity trials 
and natural experiment studies with a parallel control 
group. A search strategy including criteria for 
participants, study design, outcome, setting and 
intervention will be implemented in various electronic 
databases and information sources. Two reviewers will 
independently screen studies to assess eligibility, as 
well as extract data from, and assess risk of bias of 
included studies. A third reviewer will resolve any 
discrepancies. Attempts will be made to quantify trial 
effects by meta-analysis. Binary outcomes will be 
pooled and effect size reported using ORs. For 
continuous data, effect size of trials will be reported 
using a mean difference where trial outcomes report 
the same outcome using a consistent measure, or 
standardised mean difference where trials report a 
comparable measure. Otherwise, trial outcomes will be 
described narratively. 

Dissemination: Review findings will be disseminated 
via peer-reviewed journals and conferences. 



INTRODUCTION 

Tobacco, alcohol and illicit drug use contrib- 
ute significantly to global rates of morbidity 
and mortality/ ^ School-based interventions 
have been recommended to be implemented 
to reduce this burden given initiation of such 
drug use typically occurs during adoles- 
cence,^ and schools provide almost universal 
access to adolescents for prolonged periods. 
Given this, school-based interventions have 
been implemented by governments inter- 
nationally in an attempt to reduce adolescent 
initiation to substance use."^^ 

Despite widespread implementation, 
Cochrane reviews have found little evidence 
for the effectiveness of school-based drug pre- 
vention programmes on adolescent substance 
use, with such reviews focused on any or only 
universal intervention approaches. Of the 
multiple intervention approaches examined by 
such reviews, little or no evidence of effective- 
ness has been found for the most commonly 
implemented curricula or information-only 
interventions. Some evidence, however, has 
been found for various psychosocial interven- 
tions, including those that adopt a social com- 
petence and social influence, generic 
psychosocial or individual social skills 
approach. A review by the WHO examining 
school-based drug prevention programmes 
similarly concluded that programmes that 
promote young people's mental well-being 
were most likely to be effective, suggesting that 
interventions incorporating a mental well- 
being approach may have the best chance of 
impacting substance use.^ 

The concept of resilience and closely 
related research regarding protective factors 
provides one avenue for addressing mental 
well-being that is suggested to have an 
impact on adolescent substance use.^~^^ 
Resilience has been variably defined as the 
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process of, capacity for, or outcome of successful adapta- 

9 10 12 13 18 

tion in the context of risk or adversity. 
Despite this variability, it is generally agreed that a range 
of individual and environmental protective factors are 
thought to: contribute to an individual's resilience; be 
critical for positive youth development and protect ado- 
lescents from engaging in risk behaviours, such as sub- 
stance use.^^~^^ Individual or internal resilience factors 
refer to the personal skills and traits of young people 
(including self-esteem, empathy and self-awareness) .^^ 
Environmental or external resilience factors refer to the 
positive influences within a young person's social envir- 
onment (including connectedness to family, school and 
community). Various studies have separately reported 
such factors to be negatively associated with adolescent 
use of different types of substances, 24-36 
example, higher self-esteem^^ is associated with 

lower likelihood of tobacco and alcohol use. 

Despite this associative evidence, to the authors' 
knowledge, existing systematic reviews assessing the 
effectiveness of school-based substance use interventions 
have not reported the effectiveness of universal 
resilience-based interventions on adolescent substance 
use.^^ Three existing Cochrane reviews have individu- 
ally examined the efficacy of school-based tobacco, 
alcohol and illicit drug use programmes. Such reviews 
have not reported outcomes for universal resilience- 
based interventions specifically, but have included such 
interventions in broader categories of intervention type 
for subgroup analysis. As a consequence, a systematic 
review of the efficacy of universal resilience-based inter- 
ventions specifically remains unreported. For example, a 
tobacco-focused review which included any intervention 
type, classified interventions with a component of resili- 
ence content into different subgroups such as social 
competence or social influence interventions, finding 
evidence for both broad intervention approaches.^ For 
the alcohol-focused review, only universal interventions 
were included with such interventions grouped accord- 
ing to whether they targeted alcohol alone or targeted 
multiple substance types. ^ While meta-analysis was not 
conducted due to the heterogeneity of studies, the 
review concluded that some psychosocial and develop- 
mental prevention programmes were effective. Given 
such inability to draw conclusions with respect to univer- 
sal resilience interventions and studies suggesting an 
association exists between resilience and substance use, 
there is a need to examine whether more specifically 
defined universal resilience interventions are efficacious 
in reducing substance use by adolescents. Such a review 
has the potential to identify studies not included in exist- 
ing Cochrane reviews which, at the time of publication, 
were conducted up to 10 years ago. 



Objective 

To determine whether universal school-based interven- 
tions designed to enhance resilience are efficacious 



relative to a comparison group in reducing the extent of 
adolescent tobacco, alcohol or illicit drug use. 

METHODS 

All methods employed in the review will be consistent 
with the Cochrane Handbook for Systematic Reviews of 
Interventions.^^ 

Eligibility criteria 

Study characteristics 
Participants 

Studies will be included if they report results of partici- 
pants aged 5-18 years. Studies that select participants 
based on a diagnosis of psychiatric or other mental 
illness, cognitive or developmental disability will be 
excluded from the study. There will be no exclusions on 
the basis of study country. 

Study design 

Studies with the following designs will be included: ran- 
domised controlled trials including cluster randomised 
controlled trials; staggered enrolment trials^^ or stepped 
wedged trials"^^; quasi-randomised trials where group 
allocation is not purely random^^ quasi-experimental 
trials including non-randomised pre-post"^^; time series/ 
interrupted time-series trials including multiple baseline 
trials with independent control groups^^ preference 
trials"^^ and regression discontinuity trials^^ and natural 
experiment studies. Trials with non-random assign- 
ment of groups will be included given Medical Research 
Council recommendations that non-randomised designs 
may represent the most appropriate evaluation deign for 
some complex public health interventions,^^ and as an 
acknowledgment of the value of non-randomised 
designs in assessing intervention effects in public health 
interventions.^^ Studies with a length of follow-up of at 
least 6 months post intervention start will be included in 
the review. Studies will be excluded if they do not 
include a parallel comparison group. 

Comparison group 

Studies with a comparison group that received no inter- 
vention, usual practice, attention only or an alternate 
intervention will be included. 

Primary outcomes 

Studies will be included if they report one or more of 
the following outcomes: 

► Tobacco use (including but not limited to proportion 
ever smoked, frequency of smoking, number of cigar- 
ettes smoked, tobacco use in the past week, current 
smoking status or established tobacco use); 

► Alcohol consumption (including but not limited to 
proportion ever consumed an alcoholic drink, 
alcohol use in the past week, frequency of alcohol 
consumption, binge drinking or established alcohol 
use); 



2 



Hodder RK, Freund M, Wolfenden L, etal. BMJ Open 2014;4:e004718. doi:1 0.11 36/bmjopen-201 3-00471 8 



6 



Open Access 



► Illicit drug use (including but not limited to ever use 
or frequency of use of any illicit drug or a specific 
drug eg, cannabis, amphetamines or cocaine) . 
Substance-use data collected via various methods will 
be included, for example, data collected via observation; 
self-report via face to face or telephone, internet survey; 
secondary report by peers or parents; and biochemical 
measurement of substance use (such as carbon monox- 
ide or cotinine detection) . 

Secondary outcomes 

Any adverse outcomes reported in included studies will 
be described in the results. 

Interventions 

A study will be included if it reports a universal interven- 
tion that specifically aims to improve at least one internal 
and at least one external resilience factor. A universal 
intervention is defined as an intervention delivered to an 
entire school population. As the internal and external 
factors that comprise resilience are not consistently 
reported, numerous bodies of work were reviewed to 
identif)^ an inclusive list of internal and external resili- 
ence factors.^ Internal resilience factors will 
include: cooperation and communication, self-efficacy, 
self-esteem, empathy, problem solving, decision-making 
skills, autonomy, self-awareness, goals and aspirations, 
social and emotional skills or competence and self- 
control or self-regulation.^ ^ External resili- 
ence factors will include: meaningful participation, high 
adult expectations, caring relationships and support 
within home, school and community environments; peer- 
caring relationships and prosocial peers.^ ^^""^^ 

Given the theoretical and componentry crossover 
between resilience and other intervention approaches 
(such as strengths based, social competence, social influ- 
ence, skills focused, affective focused, social and emo- 
tional learning/ well-being, mental well-being and 
psychosocial^^"^^) , a study will be included irrespective 
of the stated overall intervention approach if it specific- 
ally aims to address at least one internal and one exter- 
nal resilience factor as defined above. Studies will be 
included irrespective of whether substance use is the 
primary outcome measure. 

There will be no exclusion criteria regarding other 
intervention elements, the duration of intervention, the 
format of intervention delivery (eg, curricula based or 
internet based) or the intervention administration (eg, 
the intervention could be delivered by school staff, 
research staff, community members or students) . 

Setting 

Studies will be included if the intervention is implemen- 
ted across a whole school. 

Publication characteristics 

Studies of any language will be included and translated 
using Google translate where required. Studies 



published in the past 20 years in peer-reviewed journals 
will be eligible for inclusion. 

Information sources 

Electronic databases 

The following electronic databases will be searched: 
Cochrane Central Register of Controlled Trials, 
MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC and 
the first 200 citations only of Google Scholar. 

Other sources 

The following additional information sources will be 
searched or contacted for eligible studies: 

► Hand searching of three relevant journals in the field 
(past 5 years; Addiction, Journal of Adolescent 
Health, Journal of School Health); 

► Reference lists of included studies; 

► Reference lists of existing Cochrane reviews on 
school-based interventions targeting tobacco, alcohol 
and illicit substances^^; 

► Corresponding authors of included studies; 

► PubMed single citation searcher. 

Search strategy 

The search strategy will include terms for participants, 
setting, intervention, study design^"^ and outcome 
(sourced from current Cochrane systematic reviews 
examining the effectiveness of tobacco, alcohol and 
illicit substance use interventions; see web only appendix 
1 for MEDLINE search strategy) The search strategy 
will be tailored as required for implementation in other 
information sources. 

Study selection 

Two reviewers will independently screen the titles and 
abstracts of all studies identified via the implementation 
of the above search strategy. The reviewers will not be 
blind to study authors. A standardised screening tool will 
be used to assess study eligibility with those titles and 
abstracts not meeting the criteria excluded from the 
review (see web only appendix 2). The full texts of the 
remaining papers will be sourced and examined inde- 
pendently by the two reviewers to assess study eligibility. 
Any disagreement between the two reviewers regarding 
study eligibility that cannot be resolved via consensus 
will be assessed by a third reviewer. Corresponding 
authors will be contacted if there is not sufficient infor- 
mation to determine eligibility. If sufficient information 
remains unavailable, the study will be deemed ineligible. 
The details of ineligible studies for which the full text 
was sourced will be reported in the Results section 
including the reason the study was ineligible. 

Data extraction 

The two study reviewers will independently extract data 
from the eligible studies using a standardised form. 
Reviewers will not be blind to study authors. Any unre- 
solved discrepancies between reviewers regarding the 
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extracted data will be resolved by the third reviewer. 
Where there is insufficient data to make a judgement 
regarding eligibility, the corresponding authors will be 
contacted for clarification. 

The following information will be extracted from eli- 
gible studies where available: authors, year of publica- 
tion, year/s of study, country, study design, intervention 
(including resilience factors targeted, duration, inten- 
sity), comparison group type, substance use targeted, 
measurement tool characteristics, study participants' 
demographics (including age and gender), study results 
(including sample size, consent rate/s, participation 
rate/s, length of follow-up, attrition, relevant outcome 
results and intraclass correlation), intervention fidelity 
(including any process measures) and information to 
determine any potential study bias (see below). 

Assessment of risk of bias 

Study bias of eligible studies will be assessed independ- 
ently by the two reviewers against the Cochrane 
Handbook for Systematic Reviews of Interventions study 
characteristics including: sequence generation (selection 
bias), allocation sequence concealment (selection bias), 
blinding of participants and personnel (performance 
bias), blinding of outcome assessment (detection bias), 
incomplete outcome data (attrition bias), selective 
outcome reporting (reporting bias) and other potential 
sources of bias.^^ 

Included non-RCTs will be assessed for selection bias 
that may have resulted in confounding of the outcome 
of interest using the Newcastle-Ottawa Scale,^^ and 
where possible statistical methods will adjust for such 
confounding. Any additional biases specific to individual 
study designs will be assessed by the reviewers and 
reported.^^ 

The reviewers will not be blinded to the names of the 
authors, institutions, journal or results of studies. Any 
disagreement between the two reviewers regarding study 
bias that is not resolved via discussion will be resolved by 
a third reviewer. 

Data analysis 

Data synthesis and analysis 

Attempts will be made to quantify trial effects from ran- 
domised controlled trials by meta-analysis using data 
from intention-to-treat analyses. Where multiple mea- 
sures (eg, biochemical and self-reported smoking status) 
for the same outcome are reported, the most objective 
measure of outcome will be used. Similarly, where 
studies report data from multiple follow-up periods, data 
from final follow-up periods will be extracted. Binary 
outcomes (such as tobacco use) will be pooled and 
effect size reported using ORs. For continuous data, the 
effect size of trials will be reported using a mean differ- 
ence where trial outcomes are reported using a consist- 
ent measure, or a standardised mean difference where 
outcomes across trials report the same outcome using 
comparable measures. Sensitivity analysis will be 



conducted excluding trials judged to be at high risk of 
bias. Meta-analyses will be performed using a random 
effects model, when there is little evidence of heterogen- 
eity (I^<50%) and only for randomised trials. Otherwise 
trial outcomes, including those from non-randomised 
trials, will be described narratively. 

Assessment of study heterogeneity 

Study heterogeneity will be assessed via examination of 
forest plots and calculation of I^ statistic. If an I^ score 
over 50% is found, the cause of the heterogeneity will 
be explored via the conduct of subgroup analyses and 
sensitivity analysis via meta-regression. 

Issues of clustering 

If any included cluster randomised controlled trials have 
not accounted for clustering, intraclass correlations will 
be requested from authors or if not available, estimates 
from similar studies (defined as those with similar 
school and student characteristics including gender and 
scholastic year proportions) will be used to adjust for 
clustering. 

Dealing with nnissing data 

Authors of included studies will be contacted to provide 
any missing data (eg, missing participant data due to 
drop out or missing statistics such as SDs). If not avail- 
able, attempts will be made to compute them, including 
an intention-to-treat analysis where appropriate. 

Assessment of reporting bias 

Possible reporting bias will be determined by examining 
funnel plots of the included studies and comparison 
with trial registers. 

Additional analyses 

If possible, additional analyses will be conducted by sub- 
group (eg, gender), intervention intensity, intervention 
duration and length of follow-up. Further subgroup ana- 
lysis is planned based on whether included interventions 
focused solely on resilience (resilience interventions) 
versus interventions that focused on resilience as well as 
other determinants of substance use (multidimensional 
interventions). 

ETHICS AND DISSEIVIINATION 

Given this is a systematic review, ethics approval is not 
required. Findings of this review will be disseminated via 
peer-reviewed journals and conference presentations. 

DISCUSSION 

This systematic review will be the first internationally to 
examine the effectiveness of universal school-based 
resilience interventions in reducing the prevalence of 
adolescent tobacco, alcohol and illicit drug use. Given 
that the majority of adolescents attend school, 
population-level implementation of an effective 
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intervention approach has the potential to provide sig- 
nificant health gains by reducing adolescent substance 
use, and as a result will be of interest to researchers and 
policy makers. 
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